Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

executor, infoschema: Add cluster_statements_summary_evicted table to TiDB #25418

Merged
merged 138 commits into from
Jun 17, 2021

Conversation

ClSlaid
Copy link
Contributor

@ClSlaid ClSlaid commented Jun 15, 2021

What problem does this PR solve?

Problem Summary:
I have added statements_summary_evicted table to TiDB in #24513, a month ago. However, I didn't add this feature for cluster information.
This PR added the feature of adding cluster information of evicted count.

What is changed and how it works?

What's Changed:
Inforschema and executor.

How it Works:
Added a new table: information_schema.cluster_statements_summary_evicted to TiDB.

Related changes

  • Need to cherry-pick to the release branch

Check List

Tests

  • Unit test
  • Integration test

Side effects

  • Performance regression
    • Consumes more CPU
    • Consumes more MEM
  • Breaking backward compatibility

Release note

  • Add cluster information of evicted count.

ClSlaid and others added 30 commits April 23, 2021 18:17
Enhance LRU cache, enable users access evicted key-value pair on Put()

Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
Release Note: enhanced LRU Cache
some type fixes to cheat CI.
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
typo fixes.
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
enhance test on lru's Put() method.

Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
Add a function property in kvcache;
Add a method to kvcache;
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
Used Gofmt
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
An initial commit, still cannot work properly.

Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
Catch up with PingCAP

Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
now we can see evicted count
debug logging expressions not deleted...

Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
STATEMENTS_SUMMARY_EVICTED now able to use

Test will be added in tomorrow.
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
Purge logging code used for debugging.
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
add test to evicted count, fix bugs in ssMap.other.

Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
Add test to stmtSummaryByDigestMap.ToEvictedCountDatum and stmtSummaryByDigestEvictedElement.ToEvictedCountDatum.
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
make disable fail-point
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
� Conflicts:
�	executor/infoschema_reader.go
�	infoschema/tables.go
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
focus on evicted count and purged unrelated contents.
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
improve AddEvicted() from O(mn) to O(n)
typo fixs
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
Signed-off-by: ClSlaid <cailue@bupt.edu.cn>
@ClSlaid
Copy link
Contributor Author

ClSlaid commented Jun 17, 2021

/run-all-tests

@ClSlaid
Copy link
Contributor Author

ClSlaid commented Jun 17, 2021

/cc @crazycs520

Copy link
Contributor

@crazycs520 crazycs520 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ti-chi-bot
Copy link
Member

[REVIEW NOTIFICATION]

This pull request has been approved by:

  • crazycs520
  • djshow832

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

@ti-chi-bot ti-chi-bot added status/LGT2 Indicates that a PR has LGTM 2. and removed status/LGT1 Indicates that a PR has LGTM 1. labels Jun 17, 2021
@crazycs520
Copy link
Contributor

/merge

@ti-chi-bot
Copy link
Member

This pull request has been accepted and is ready to merge.

Commit hash: cff70d7

@ti-chi-bot ti-chi-bot added the status/can-merge Indicates a PR has been approved by a committer. label Jun 17, 2021
@ti-srebot
Copy link
Contributor

cherry pick to release-5.1 in PR #25587

ti-srebot pushed a commit to ti-srebot/tidb that referenced this pull request Jun 21, 2021
Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
ti-srebot pushed a commit to ti-srebot/tidb that referenced this pull request Jun 21, 2021
Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
@ti-srebot
Copy link
Contributor

cherry pick to release-4.0 in PR #25588

ti-srebot pushed a commit to ti-srebot/tidb that referenced this pull request Jun 21, 2021
Signed-off-by: ti-srebot <ti-srebot@pingcap.com>
@ti-srebot
Copy link
Contributor

cherry pick to release-5.0 in PR #25590

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs-cherry-pick-release-5.0 needs-cherry-pick-release-5.1 sig/execution SIG execution sig/sql-infra SIG: SQL Infra size/M Denotes a PR that changes 30-99 lines, ignoring generated files. status/can-merge Indicates a PR has been approved by a committer. status/LGT2 Indicates that a PR has LGTM 2.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants